Reliability of frequency- and amplitude-decoding in gene regulation 
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In biochemical signaling, information is often encoded in oscillatory signals. However, the ad- 
vantages of such a coding strategy over an amplitude encoding scheme of constant signals remain 
unclear. Here we study the dynamics of a simple model gene promoter in response to oscillating 
and constant transcription factor signals. We find that in biologically-relevant parameter regimes 
an oscillating input can produce a more constant protein level than a constant input. Our results 
suggest that oscillating signals may be used to minimize noise in gene regulation. 



Cells are constantly exposed to a range of environmen- 
tal stimuli to which they must respond reliably. In recent 
years, it has become increasingly clear that cells use com- 
plex encoding strategies to represent information about 
the environment in the temporal dynamics of intracellu- 
lar components [T]. In particular, oscillatory or pulsatile 
signals are commonly found in signaling and gene regu- 
latory networks Perhaps the best known example is 
the phenomenon of calcium oscillations 3J. Oscillatory 
dynamics have also been observed at the level of gene 
regulation in nuclear localization of signaling proteins [3] 
and transcription factors [5rE7] and in transcription fac- 
tor expression [5]. Yet the advantages of such a coding 
strategy for signal transmission remain unclear. 

A number of possible advantages for oscillatory signals 
have been suggested. Oscillatory signals minimize the 
prolonged exposure to high levels of calcium, which can 
be toxic for cells [9] . In systems with cooperativity ^lOj an 
oscillating signal effectively reduces the signal threshold 
for response activation. Pulsed signals also provide a way 
of controlling the relative expression of different genes 
[7]- However, these studies have ignored the impact of 
biochemical noise on the reliability of signal transmission. 
Encoding of signals in protein oscillations may play a 
direct role in ensuring accuracy in intracellular signaling. 

Variability in the cellular response to an external signal 
will arise from the temporal pattern of network activa- 
tion and from inevitable biochemical noise in the reac- 
tions making up the processing network, both of which 
will depend on the coding strategy employed. A reliable 
response requires minimization of such variability. En- 
coding of stimuli into oscillatory signals can reduce the 
impact of noise in the input signal and during signal prop- 
agation However, it remains unclear whether oscil- 
latory signals can also be decoded with a similar fidelity 
to constant signals - one might expect that the inherent 
variability of an oscillatory signal would inevitably lead 
to a more variable response. In this paper we investi- 
gate whether oscillatory signals can be reliably decoded 
in a simple model of gene regulation. Surprisingly, we 
find that in biologically-relevant parameter regimes an 
oscillating input can lead to a more constant output pro- 
tein level than a constant input. This effect arises from 
differences in promoter state fluctuations, which it has 
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FIG. 1: A gene promoter driven by constant and oscillating 
signals, s{t). We compare the variances of X for the two input 
signals, crx,c a^nd crx,oi a^t the same mean level (X). 



recently been shown can be a dominant source of noise 
in vivo fT2]. 

We focus on the simple regulatory motif (Fig. [T]) of a 
single gene promoter which can be in an active (P*) or 
inactive (P) state. The input to the system is the activity 
s{t) of a transcription factor which enhances activation of 
the promoter. A protein X, whose level X{t) constitutes 
the network output, is transcribed from the active pro- 
moter; proteins also spontaneously decay. The system 
therefore consists of the reactions 
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We will consider two forms for s{t). In the first instance 
we take s{t) = a to be constant. In the second, s{t) is 
oscillatory, refiecting the action of a periodic upstream 
signal or the inherently oscillatory dynamics of the tran- 
scription factor. Since transcription factor pulses often 
resemble distinct sharp peaks [SHI] we take s{t) to be a bi- 
nary switching process, with s{t) = 1 for nT < t < nT+r 
[n e Z) and s{t) = otherwise (see Fig. [T]). This form 
also has the advantage of making the dynamics analyt- 
ically tractable. We characterize the system response 
in terms of the means (AT), {P*) and variances (j\,(t^,; 
for the oscillating input we define the stationary mean 
{X) = T-^ j^¥.[X{t)]dt, where E [] denotes averaging 
over network realizations with the same input, and the 
stationary variance a\ = T'^ ^'^ V. [X{tf] dt - (X)"^. 
These are calculated from the chemical master equation 
|13j . and verified by stochastic simulations jl_4 . 

When driven by a constant signal the promoter simply 
undergoes random switching with constant rates. Hence 



2 



the probabihty of the promoter being active at any time 
is (P*)c = olkI{olk, + A). For an oscillating input the 
average activity, 



(^*>o = 



K + A 



T K(l-e-('^+^)^)(l-e-^(^-^)) 
T ^ Ar(K + A)(l-e-«^-^^) 



contains a term from the expected promoter activity 
when s — \ multiplied by the fraction of time, t/T, 
for which s{t) — 1, and a correction due to the fact 
that the promoter response timescales when s(i) = 1 
and s{f) = ([k + A]~-^ and A~^, respectively) differ. 
Since promoter switching is a two-state process the vari- 
ance in promoter activity is determined by the mean, 
a\, = (P*)(l — (P*)). The mean protein level also has 
the same form for both input signals, {X) — p{P*) / ^. 
However, differences in the timing of protein production 
will mean that the variance in the protein level differs be- 
tween the two signals. For a constant signal the variance 
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consists of an intrinsic Poissonian term due to random- 
ness in protein production, and an extrinsic contribution 
from fluctuations in the promoter state. The variance 
given an oscillatory input a\ ^ can similarly be derived, 
but the full expression is unwieldy and thus not presented 
here. In the following we will compare a\ ^ with a\ ^ at 
the same mean response level, achieved by choosing the 
level of the constant signal a = a(T, T, k. A) such that 
(P*)c = (P*)o = (P*), and hence also {X)^ = {X)o = 

It is instructive to first consider cases in which the two 
input signals lead to similar distributions for X. First, 
if p, /X — ^ oo with Xoo = p/fJ- held constant, whenever 
the promoter is inactive the protein level is X{t) = 0, 
while when the promoter is active the protein level will 
be Poisson-distributed with mean X^o- The variance in 
X is then given by aj^^^ = (t|_„ = {X)[l+X^ - {X)]. In 
this limit of fast protein dynamics the precise pattern of 
promoter switching does not affect the variance in pro- 
tein expression. At the other extreme, if either promoter 
switching or protein production is slow compared to the 
oscillating input (k, A ^ or p, /x <C T~^), the slow 
reactions effectively integrate over the temporal variation 
of the input. Since the network dynamics is too slow to 
reliably respond to the oscillating signal, the protein re- 
sponse is equivalent to that for the constant input. 

Differences appear between the variances for the oscil- 
latory and constant signals in the biologically most im- 
portant regime of intermediate parameter values, where 
the promoter is able to respond to the oscillating input 
signal, protein production can react to switching of the 
promoter, and the protein lifetime is sufficiently long that 
patterns of promoter activity are important. Figures[2ja- 
c) show that there exist regions in which either the con- 
stant or oscillating signal leads to smaller fluctuations cr^ 



over large parameter ranges. Here we consider param- 
eter ranges representative of eukaryotic cells, in which 
promoter switching occurs on a timescale of minutes to 
hours [m [TS] and protein lifetimes are in the range of 
a few to hundreds of hours [TB]. The timescale of the 
input signal is chosen to be representative of NF-kB os- 
cillations [S]. However, we emphasise that out results are 
general and would apply equally to prokaryotic cells in 
an appropriate parameter regime. 

To understand the noise properties for the two input 
signals we consider the network response in the frequency 
domain. The dynamics of X{t) can be described by the 
Langevin equation 



dX 
~dt 



= pP*{t)-fiX{t)+iit), 



(2) 



where ri{t) represents Gaussian white noise with (r;(t)) — 
and {■n{t)T]{t')) = (pE[P*(t)] + pE[X{t)])5(t ~ t') [IT]. 
Using the spectral addition rule [18 it is straightforward 
to calculate from Eq. [2 the power spectrum of fluctua- 
tions in X{t), ^p^Sp{uj) + S',,(w)] /{u'^+p'^), in 
terms of the spectra of promoter fluctuations Sp{uj) and 
of intrinsic noise in the production and decay of X, S'^(a;). 
The variance a\ can be found by integrating S'x(w) over 
all frequencies, and can therefore be written as the sum 



of intrinsic and extrinsic terms, a\ — a, 



g'^{uj)Sp{uj)duj, 



with 



S',,(w) 



diu, (3) 



where g^i^j) — p^ jiuP' + /x^) is a signal-independent gain 
factor. The intrinsic noise u\-^ = {X) is also independent 
of the input signal. Any differences between a\ ^ and 
o\ ^ must, therefore, arise from differences in Sp(u:). 

For a constant input, 5'p,c(w) = 2a'],,Tp / {uj'^Tp + 1) 
(Fig. [2][d), blue line) has a simple Lorentzian form due 
to random promoter switching, with rp — [an + A)~^ 
the switching correlation time. A general expression for 
Sp^o{uj) with an oscillating input is more difficult to cal- 
culate. However, simulations show (Fig. [2jd), red line) 
that there are two significant components. First, there 
are sharp peaks at frequencies corresponding to the signal 
period lut — 2t: /T and multiples thereof, reflecting sys- 
tematic changes in E[P*(t)] due to the periodicity of s{t). 
Second, S'p_o(w) includes an approximately Lorentzian 
noise background associated with random (Poissonian) 
switching of the promoter when s{t) = 1 and delays in 
deactivation when s{t) = 0. 

The protein lifetime rx = relative to the signal 
period T is particularly important in determining which 
signal minimizes the output noise. The constant signal 
typically leads to smaller fluctuations when tx < T (see 
Fig. [2];a)). In this regime, for the oscillatory signal a^^ 
is dominated by contributions from the peaks of Sp^oi^) 
appearing at lu — tuot, since p > ujt and the gain g'^{uj) is 
large for frequencies oj < p (Fig.[2jd), dashed line). Con- 
sequently, X{t) features large production bursts when the 
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FIG. 2: (a) Relative noise for oscillating and constant sig- 
nals, log2(o"|^,o/''"x,c)i 8-8 the protein degradation rate and 
promoter deactivation rate A are varied. In red (blue) re- 
gions the oscillatory (constant) signal leads to lower noise. 
Other parameters are: r = 25min, T — lOOmin, k = lmin~^, 
p = 50min~^. The dotted line indicates . (b,c) Typical 
time-series of Xit) for the parameter combinations denoted 
in (a) by o (b: A = 0.2min~'^,^ = 0.05min~^) and o (c: A = 
0.2min~^,/i — 0.00167min~^). Unless otherwise noted, pa- 
rameters as in (c) are used in panels (d-g). (d) The promoter 
power spectrum Sp(lS) and gain g^iyj)! (? — -\- [^'\~^ . For 
both inputs there is a noise background due to randomness 
in promoter switching. Peaks appear in Sp,o(bj) at a; = wjjt 
due to the periodicity of the oscillating input signal, (e) Dis- 
tribution of the fraction of time the promoter is active in an 
interval rx, calculated from stochastic simulations. The os- 
cillatory signal leads to more reproducible promoter activity 
on the timescale rx. (f) Variance against mean output level 
as T is varied with r held constant. The oscillating signal 
can achieve a lower variance over nearly the full range of out- 
put levels. In (f) and (g), lines show exact analytic results, 
points show results of stochastic simulations, (g) Fano factor 
a\/{X) as K is varied with constant K = Xj k — 0.2. For 
slow switching kt < 1 the two signals become equivalent. For 
extremely fast switching the constant signal minimizes a\. 
At intermediate switching rates, O.lmin^^ 1^, ^ 1^, 18min^^, 
the oscillating signal allows for smaller g\. 



signal is "on" with most proteins decaying before the next 
input pulse, while for a constant signal production and 
decay are more regularly distributed (see Fig. [2]^b)). 

For long protein lifetimes tx > T, a\ ^ is typically 
smaller than <j\ ^ (see Fig. j2|a)). In this regime the 
impact of production bursts is reduced because proteins 
produced during many previous signal periods contribute 
to X(t\ Since \i < lot, the region w < where 



is largest does not reach the first peak of Sp^o{i^) at ujt 
(Fig. [2jd), solid black line); hence a'^^ is dominated by 
promoter switching noise at low frequencies uj < lot, for 
which Sp,o{lo) < Sp^ci'^)- The large amplitude changes 
of the oscillatory signal strongly bias the promoter to be 
active during a signal pulse and to be inactive between 
pulses, which in turn greatly reduces the probability of 
observing very long periods of promoter (in)activity. The 
elimination of such slow promoter fluctuations, which 
lead to the largest fluctuations in X{t), means that on 
the timescale of the protein lifetime, promoter activity 
becomes more reproducible and the production of pro- 
teins becomes less variable when driven by an oscillatory 
signal (Fig. [2|e)). Furthermore, Fig. [2]jf) shows that in 
this regime a 



< a 



over nearly the full range of ex- 
pression levels as the signal period T is varied, indicating 
that this result does not require fine tuning of the reac- 
tion rates to the oscillation timescale. 

Output noise (j\ tends to decrease as promoter switch- 
ing is made faster (Fig. [2jg)): increasing the promoter 
switching rate reduces Sp{uj) at low frequencies, shifting 
power instead to high frequencies where g'^^Lo) ^ lo^'^ is 
small. Interestingly, for extremely fast switching the con- 
stant signal is able to achieve a smaller variance. In this 
limit noise in promoter switching becomes negligible, and 
Eq. [T] reduces to 



p's(t) 



> X 



With a constant signal the effective production rate of 
X is = p{P*)/a and a^,, = (X) = a^; al^ (Eq. g 
can be made arbitrarily small by shifting all promoter 
fluctuations to extremely high frequencies. With an 
oscillatory input the effective production rate becomes 
= p/{l + K), where K = X/k. The resulting variance. 
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includes a (positive) extrinsic contribution. While the 
promoter switching noise background in S'p.o(w) van- 
ishes, as with a constant signal, the peaks due to the 
periodicity of s{t) remain. Hence for an oscillatory in- 
put there will always be some overlap between Sp^oi^) 
and g^{Lo), and a non-zero extrinsic noise a^^. With the 
reaction rates representative of eukaryotic transcription 
used in Fig. pig) , the cross-over at which a\^ = a\^is 



K ~ 18min~ . Experimentally-determined rates of pro- 
moter activation, however, are typically 0.01 — Imin^^ 
[m [TS] , which suggests that under biologically-relevant 
conditions oscillatory signals can lead to more robust pro- 
tein expression. 

Thus far we have assumed that the signals s{t) are 
deterministic. In reality, these signals will also be noisy as 
they are themselves generated by stochastic biochemical 
processes. An important question is whether oscillatory 
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FIG. 3: Effects of noise in (a) oscillation amplitude, and 
(b) the duration of "on" and "off" periods. Solid lines show 
results for constant (blue) and deterministic oscillatory (red) 
stimuli. Even with significant variability in amplitude or tim- 
ing, the oscillating signal leads to a smaller (j\ than a constant 
signal. Parameters are as in Fig. [2]^f). 

signals can still be decoded more reliably once noise in 
the input stimulus is taken into account. 

We first consider the effect of transcription factor copy- 
number fluctuations around a constant mean by simulat- 
ing s(t) as a birth-death process. We find that a\ at 
fixed (X) increases monotonically as the variance or cor- 
relation time of s(i) are increased. Therefore, without 
additional non-exponential temporal correlations in the 
input signal, noise is unable to reduce a\ below that 
achieved with s(t) = a. 

For an oscillatory input signal there are two principal 
types of noise: fiuctuations in the amplitude and timing 
of signal pulses. First we perform simulations in which 
on each occasion that the oscillatory signal switches "on" 
the amplitude s{t) = a is sampled from a log-normal dis- 
tribution with mean a = 1 and width parameterized by 
= ln[a^]. Figure jsj^ a) shows that cr^ is largely un- 
changed until the noise in the pulse amplitude becomes 
large. Even with ^ ^ 1 {(Ja/a 1.3) the output noise 
is typically smaller than for a constant, noiseless, input 
signal. Intuitively, in the regime where an oscillating 
signal leads to a smaller tr^, K ^ 1; the promoter ac- 
tivity is driven to saturation during a signal pulse and 
hence amplitude fluctuations have little effect until there 
is a significant probability that a ^ K. The decoding 
of large-amplitude oscillatory signals is therefore highly 
robust to noise in the oscillation amplitude. 

We next investigate by simulations the effect of noise 
in the duration of signal pulses and inter-pulse intervals. 
The duration of each "on" period is chosen independently 
from a gamma distribution with mean r and shape pa- 
rameter fcon- The resulting variance in "on" durations is 
a^^^ = r^/fcon- "Off" periods are similarly sampled from 
a distribution with mean T — t and parameter fcoff • Fig- 
ure [sjjb) shows that the noisy oscillation can lead to pro- 
tein level fiuctuations which are similar to or smaller than 
CT^ c even when variability in signal timing is significant 
{kon = 5 gives crt^^/r ~ 0.45). Experimentally-observed 
fiuctuations in oscillation periods or peak widths vary 



between different systems but can be 20 — 30% [H [TH] , 
suggesting that in vivo oscillations can be sufficiently pre- 
cise as to reduce output noise compared to a constant- 
amplitude signal. 

The simple model of gene expression considered here 
neglects mRNA dynamics and processing. Such pro- 
cesses can affect the propagation of promoter-state fiuc- 
tuations in two ways. First, mRNA dynamics will in- 
tegrate over promoter fiuctuations on timescales shorter 
than the mRNA lifetime (typically tens to hundreds of 
minutes in eukaryotic cells [121 dO])- However, differences 
between cr^ ^ and ^ are primarily due to promoter- 
state fluctuations on timescales comparable to or longer 
than the slowest timescale of variations in the protein 
level, which is typically determined by the protein life- 
time (ten to a hundred hours [H]). Promoter fiuctua- 
tions on these long timescales can not be filtered by the 
mRNA dynamics, and hence even with mRNA dynam- 
ics taken into account an oscillatory input will lead to 
more robust expression since an oscillatory signal sup- 
presses promoter fiuctuations on timescales longer than 
the signal period (see Fig.[2][d)). Second, a (random) de- 
lay between transcription initiation and protein synthesis 
will be introduced. However, such delays will only sig- 
nificantly affect the number of proteins produced on the 
timescale rx if the width of the delay distribution itself 
becomes comparable to the protein lifetime, which seems 
unrealistic. Hence we conclude that mRNA dynamics 
will have little effect on our results. 

It is believed that biochemical networks employ 
frequency-encoding schemes in which stimuli are rep- 
resented in the frequency of oscillations of signaling 
molecules [31 [?]■ Our results suggest that frequency- 
encoding may allow for more reliable signaling than 
amplitude-encoding schemes because oscillatory signals 
can be decoded more reliably. 
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